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Abstract 

The notions of asymptotic amplitude for signals, and Cauchy gain for input/output sys¬ 
tems, and an associated small-gain principle, are introduced. These concepts allow the 
consideration of systems with multiple, and possibly feedback-dependent, steady states. A 
Lyapunov-like characterization allows the computation of gains for state-space systems, and 
the formulation of sufficient conditions insuring the lack of oscillations and chaotic behav¬ 
iors in a wide variety of cascades and feedback loops. An application in biology (MAPK 
signaling) is worked out in detail. 


1 Introduction 

In this note, we introduce the notions of asymptotic amplitude for signals and associated Cauchy 
gains for input/output systems. We present a simple small-gain principle for Cauchy gains, and 
a Lyapunov-like characterization which allows the estimation of gains for state-space systems. 

The concepts and results given here should be of general interest in nonlinear stability 
and control, especially in those cases in which classical small-gain theorems cannot be applied 
because the location of closed-loop steady-states depends on the precise gain of the feedback 
law, or because there are multiple such states. 

In developing these ideas, we were originally motivated by the problem of guaranteeing the 
non-existence of oscillations in certain biological inhibitory feedback loops, and specifically in 
a mathematical model of mitogen-activated protein kinase (MAPK) cascades, which represent 
a “biological module” or subcircuit which is ubiquitous in eukaryotic cell signal transduction 
processes. (We are greatly indebted to Stas Shvartsman for bringing to our attention this 
problem and especially Kholodenko’s paper |^], which dealt with the onset of oscillations under 
high gains.) The general results are illustrated with a numerical computation involving MAPK 
cascades. 
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1.1 Cauchy Gains 


For any metric space M, we write the distance dM{cL,b) between any two elements a,b € M, 
in the suggestive form “|a — 6 |” even when M has no linear structure (so the ” sign has no 
meaning, of course), and define the asymptotic amplitude of a function u) : M>o — >■ M, where 
I^>o = [ 0 ,+oo), as follows: 

||a;||aa := limsup — a;(s)| = lim ( sup |a;(t) — ti;(s)| ) € [ 0 , oo] . 
s,t^oc T^oo\t^s>T ' 


Observe that the condition “||ci;||g^£^ = 0” amounts to the Cauchy property for a;: for every 
e > 0 there is some T > 0 such that |a;(t) — a;(s)| < e for all t,s > T. Thus, when M is a 
complete metric space (for instance, if, as in all our examples, M C R™ is any closed subset of 
a Euclidean space): 

11‘^ILn = 0 3 lim a;(t). 

If = 0, we denote := limt^oo^^(i)- 

Let U and y be two complete metric spaces. We define a behavior with input-value spaee 
U and output-value spaee T as a relation TZ between time-functions with values in U and y 
respectively: 

n c [R>0 -^U]x [R>0 ^ T] 


where [R>o —> M] is the set of functions R>o —> M. We call any element {to^r]) ^ TZ an 
input/output pair, and say that u> is an input signal and p is an output signal of TZ. 


Typical examples of behaviors, to be discussed in detail later, are those obtained by starting 
with a system of differential equations with inputs (“forcing functions” or “controls”) to, and 
viewing the solutions obtained by solving the system with different initial states, or some 
components of these solutions, as the outputs t]. The formalism that we use, based on abstract 


relations for the formulation of small-gain results, dates back to Zames’ original paper |^|, and 
the term “behavior” is borrowed from Willems’ work [p^ ]. 

We use standard terminology for comparison functions: /Coo is the class of continuous, 
strictly increasing, and unbounded functions 7 : R>o ^ R>o with 7(0) = 0. 


Definition 1.1 A behavior TZ has Cauchy gain 7 G /Coo if 

ll^llaa < 7(lkllaa) 


for all €TZ. □ 

The existence of a Cauchy gain for TZ implies, in particular, the following converging input 
converging output property for TZ'. if u}{t) —> u as i —> 00 , for some u (that is, if ||w||g^g^ = 0), 
and if (w, rf) G TZ, then also rj{t) y as t 00 , for some y € y. 

The interconnection that results when the output of a system TZ is fed back to its input under 
the action of the system (feedback law) S is pictorially represented in Figure |^. The behavioral 
terminology gives an easy way to define formally the meaning of this interconnection: if TZ and 
S are behaviors, then the signals that appear when the loop is closed are precisely those pairs 
(a;,7/) such that (w,??) G TZ and (r/,a;) G S. Put another way, the feedback connection is simply 
the behavior where, for any behavior S with input-value space T and output-value 
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Figure 1: Feedback Interconnection 7^n‘5 ^ 


space U, we denote by 5 ^ the inverse behavior, with input-value space U and output-value 
space consisting of all pairs (w,//) such that (r/,a;) G S. 

With this formalism, the basic “small gain principle” is trivial to establish. It states that 
the interconnection of two systems having Cauchy gains whose composition is a contraction, has 
the property that the external signals u: and r/ must always converge to some value as t ^ oo, 
at least if they are known to have finite asymptotic amplitude: 

Lemma 1.2 (Small gain lemma for asymptotic amplitude.) Suppose that TZ and S are two 
behaviors with Cauchy gains 71 and 72 respectively, and that the following condition holds: 

li{l 2 {'r)) < r Vr > 0 . (1) 

Then, for all (w,//) G for which ||u;||a,a < 00 , ||a;||aa = ||??|laa = 0- 

Proof. Since (a;, 7 ) G TZ, ||7||aa < 7i(lkllaa); and since also (7,0;) G 5, ||a;||aa < 72(||7llaa)- 
If hllaa + fhaa hllaa ^ 7i(72(||7llaa)) < ll^llaa’ a contradiction. Finally, ||w||aa < 
72(||??|laa) = 72 ( 0 ) = 0 gives that also ||a;||aa = 0. I 


Remark 1.3 Note that the condition “||w||aa < 00 ” is equivalent to ultimate boundedness, 
i.e. there are a bounded set C C and some T > 0 such that uj{t) G C for all t > T. 
(Writing \u\ := |u — 0| for some fixed element 0 ^ U: if there are some c,T > 0 so that 
|a;(t)| < c for all t > T then ||a;||aa < 2c; conversely, if sup^ ^>' 7 ^ 1^(1) “<^(•5)1 < c for some T 
then \w{t)\ < c + \uj{T)\ for all t > T.) In applications to feedback loops involving differential 
equations, all signals are continuous, and for them, ultimate boundedness is equivalent to just 
boundedness. □ 

The limiting values of the signals io and 7 , whose existence is asserted by Lemma need 
not be unique; for instance bistable systems give rise to nonuniqueness. In order to present a 
condition which guarantees uniqueness, we introduce a new concept. 

Definition 1.4 A behavior TZ has incremental limit gain k G /Cqo if the following property 
holds: 

limsup |7i(t) - 72(t)| < 

t^OO 

whenever (a;*, 7 *) G TZ are any two pairs with the properties ||wi||aa, ~ ll^2|laa ~ 
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In words, this definition says that, if we are given two input/output pairs for which the inputs 
converge, and if the limits of the two inputs are close to each other, then the outputs become 
asymptotically close to each other. If TZ has an incremental limit gain k, and if in addition 
TZ also admits a Cauchy gain, then both and rj^ exist whenever ||wi||a,a = ll^sllaa ~ 
(converging-input converging-output), and thus the “limsup” in Definition 1.4 is a limit, and 
the estimate becomes: 

( 2 ) 

With this concept, we have another obvious observation: 


Lemma 1.5 (Small gain lemma for asymptotic amplitude, with uniqueness.) Suppose that IZ 
and S are two behaviors with Cauchy gains 71 and 72 respectively, and incremental limit gains 
Ki and K 2 respectively, and that the following condition holds: 

< r Vr>0 (3) 

in addition to O- Then, there exist two elements u € U and y € y such that, for every 
input/output pair [lo,!]) G for which ||w||aa < 00 , = u and 7]°° = y. 


Proof. If 7 ^Pi 5“^ = 0, there is nothing to prove. Otherwise, pick an arbitrary (a;i,r/i) G 
7?,p5“^ for which ||wi||g^g^ < 00 . From Lemma there exist u := and y := . Pick 

now any other {u! 2 ,r] 2 ) G 7?.p5“^ for which ||u; 2 ||aa < 00 ; again by the Lemma, lo^ and 
exist. By the incremental limit gain property, in the form (|^, both \y — r]^\ < Ki(|h — 
and \u — iof^\ < K 2 {\y — r]^\). From 

\y-v?\ < i^i{n2{\y-r]T\)) 


we conclude that t]^ 


y, and so also uj^ = u. 


Once the appropriate definitions have been given, the two Lemmas are quite obvious. The 
harder step is, often, to verify when the Lemmas apply. In order to carry out such an application, 
one needs to find sufficient and easy to check conditions which guarantee the existence of Cauchy 
and incremental limit gains, for the systems whose feedback interconnection is being studied. 


We will mainly study behaviors TZ which can be built up from cascades of simpler behaviors 
TZi, each of which is either defined by a system of differential equations, by a pure delay, or by 
a memoryless nonlinearity. The composition TZ will represent the input/output pairs of a large 
set of delay-differential equations. The Cauchy and incremental limit gains of the behaviors TZi 
can be composed, so as to provide the gains of the complete system TZ. Section ^ describes these 
general ideas. Section ^ shows how to estimate gains based on contractions of omega-limit sets 
of signals, and these types of estimates are used in order to justify the Lyapunov-like methods 
described in Section ^ for state-space systems. Finally, Section ^ specialized the results to a 
class of inhibitory feedback loops, and in particular for the motivating MAPK example. 


This work is related to other work on “nonlinear gain” small-gain theorems such as 0,ii, 
which in turn was motivated by classical small-gain theorems as in 0 , 0 , 0 , [2l[| . Future 
developments will include generalizations to estimates which quantify overshoot, in the ISS 
(cf. Ijl^) sense. 
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2 Simple Behaviors and Cascades 


The delay-T operator D,- on U, where r > 0, is the behavior, with y = U, defined by: (w, rf) G Vr 
if and only if r/(t) = u){t — r) for all t > t. (The value of the output for t < t is arbitrary; in an 
abstract dynamical systems sense, it forms part of the specification of initial conditions.) It is 
clear that Vj- has Cauchy gain I and incremental limit gain I, where I is the identity function, 
I{r) = r. 

Given any map -.lA ^ y, the memoryless behavior associated to ip, which we denote by 
is the behavior consisting of all pairs of functions {co,r]) such that r]{t) = ip{uj{t)) for all 
t. Suppose that ip is a Lipschitz map: for some A > 0, \ip{ui) — ^^(^ 2)1 < A |ui — U 2 \ for all 
ui,U2 G lA. Then has Cauchy gain XI and incremental limit gain XI, where XI{r) = Xr. 

Suppose that IZ C [M>o U] x [M>o —T] and S C [R>o — > T] x [M>o ^ Z] are two 
behaviors, with Cauchy gains 71 and 72 respectively, and consider the cascade combination 
shown pictorially in Figure |2| and defined formally as: 

S oK := {(a;,C) | (3r/ G [M>o ^ T]) s.t. {uj,r]) G K k {r],C) G S} . 

Then, clearly, S oIZ has Cauchy gain 72 o 71 . Suppose now that also IZ and S have incremental 
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Figure 2: Cascade S oIZ 


limit gains ki and K 2 respectively. Let (u>i,r]i) G IZ and {rji,Q) G S, = 0, for i = 1,2. 

We have that rjpy and exist, and (^) holds with k = ki. Similarly, since S has a Cauchy 
gain, and exist, and |Ci° — C^| < i^2{\vT ~ ^ 2 °l)- Therefore 

iCr-Cs^l < K2{ki{\u:T-u^T\)) 

and hence S oIZ has incremental limit gain K 2 o ki . 

2.1 Tighter Estimates: Relative Gains 

Tighter estimates of gains for the cascade S o IZ can make use of the following observation. 
Suppose that the possible output signals of IZ all tend, as t —> 00 , to values in a restricted 
subset Y ol y. Then the relevant gains 72 , K2 should be the gains of S when restricted to those 
signals of the form (//, C) € <S such that rj G [R>o —> Y], These gains may well be smaller than 
the original ones, so that smaller overall gains result for the cascade. Let us make this precise. 

For any subset Uq C lA, we write “a; —> I7o” if converges to Uq as t ^ 00 , that is, for 
every e > 0 there is some T > 0 such that 

u;{t) G B^{Uo) = {u gIA \ {3u' G Uq) \u — u'\ < e} 

for every t >T. 

Let Uq YU and let IZ C [R>o —>• ZL] x [R>o —>■ T]- We will say that IZ has a Cauchy gain 
7 on Uq if ||f?||a,a — Adl^llaa) f^oids for each input/output pair {io,T]) G IZ for which lo Uq. 
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Similarly, we say that TZ has incremental limit gain k on Uq if limsup^^oo Ihi(^) “^2(i)| < 
— oJ^\) holds whenever {uji,r]i) G TZ are any two pairs such that uof^ and uj^ both exist 
and belong to Uq. In the special case Uq = U, one recovers the dehnitions of Cauchy and 
incremental limit gains. 

Suppose now that there are two sets Uq and Yq uy such that; 

• 7 Z has Cauchy gain 71 on Uq. 

• S has Cauchy gain 72 on Yq. 

• Whenever (w, 7) G 7 ^ is so that oj ^ Uq, necessarily r] ^ Yq. 

Then, clearly, SoJZ has Cauchy gain 72071 on Uq. An analogous conclusion holds for incremental 
limit gain on Uq. 


3 A Sufficient Condition 

Recall that, for any metric space U and function ui : M>o ^ U, the omega-limit set O = is 

the set consisting of those points u gU foi which there exists a convergent sequence ta{ti) —> u, 
for some sequence {ti} C M>o such that —> 00 as i —> 00. The following properties are 

elementary: ( 1 ) the set 0 is closed; ( 2 ) if cu —> C/ and U is closed, then 0 C [ 7 , and so 0 is 

compact if U is; ( 3 ) provided uj is precompact, that is to say, if there is some compact subset 
U (G U such that uj{t) G U for all f > 0 , then 0 is compact, and a; —> 0 (proof of this last 
statement: if there is some e > 0 and some sequence fi —> 00 such that uj{ti) G U \ Bs{^) 
for all i, then one can pick a subsequence of {ti} such that uj{ti.) —> u for some u, and thus 
u G U \ a contradiction since m G by definition of 17 ); ( 4 ) if to is precompact and 

is a continuous function of t, then is connected (proof; otherwise, there are two nonempty 
compact subsets with = fli (J 112 and, for some e > 0, dist(ni, n2)>3e, and by ( 3 ) some 
T > 0 such that uj{t) G B = Bg(Q) for all t > T; from fli C we know that there is some 

ti > T such that uj{ti) G Bi = B^{ni) and from Q2 U Q that there is a t2 > ti such that 

U}{t2) G B2 = B^{Q2), so, noticing that B = Bi\J B2 and that i?i P| R2 = 0 by choice of e, and 
writing X := {u}(t),t G [ti,t2]}, we have that this connected set can be written as a disjoint 
union I = (XP| Ri) |J(XP| R2) of nonempty closed sets, a contradiction). 

In general, we denote by \U\ the diameter sup{|u — u| \ u,v G U} oi a closed subset U of a 
metric space U. For each to : M>o —> U, it holds that |n+[ti;]| < ||w||g^^, and, if uj is precompact, 

ll^^llaa = • (4) 

Indeed, pick any e > 0 and two elements u,v G it such that \u — v\ > |II| — e; then there are two 
sequences uj{ti) u and u;(si) —> v, so ||w||aa = limsup^ l‘^( 7 ) “ <^( 5)1 > 1^^ — 'v| > |II| — £• 
As this is true for every e > 0 , we have ||ci^||aa — 1 ^ 1 - Conversely, if \uj{ti) — ti;(si)| > ||w||aa “ £ 
for some two sequences —> 00 and s* —> 00, we may extract hrst a subsequence of {ti} such 
that uj{ti.) is convergent (precompactness is used here), and then a subsequence of so 

that, without loss of generality we may suppose that uj{ti) —> u and uj{si) —> v for some u,v G it, 
and thus |n| > |n — u| > ||w||aa “ so letting e —> 0 gives the other inequality. 

We say that a mapping T assigning subsets of one set to subsets of another is monotonic if 
UiCU 2 ^ T{Ui) C T{U 2 ). 
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Lemma 3.1 Suppose given a behavior IZ, a compact subset Uq a function 7 G /Coo a-iid 
a mapping F from compact subsets of C/q to subsets of y, such that the following properties 
hold: 

(a) For each (a;, 7) G TZ for which C Uq, the output 7 is precompact. 

(b) For each compact subset U C Uq, and each (cu, 7) G for which n+[a;] C U, it holds that 
Q+[r]] C T{U). 

(c) For each compact subset U C Uq, it holds that |F(C/)| < 7(|C/|). 

Then TZ has Cauchy gain 7 on Uq and incremental limit gain 7 on Uq. Moreover, for each 
compact subset U C Uq, and each (a;,7) G TZ for which a; —> [/, 7 —> F(n'''[a;]). If F is 
monotonic, then also rj —> F(? 7 ). 

Proof. Pick any (a;,^) G TZ and any compact U C Uq, and suppose that uj U. By ( 1 ) and 
( 2 ) in the previous discussion, the set is a compact subset of U. By (a), 7 is precompact. 

Therefore H^Haa = also 7 —> 12 "''[7]. By (b), applied to hi "'“[a;] itself, we know 

that fl''~[7] C F(Q'*'[a;]), which gives the conclusion 7 ^ F(fl'*'[a;]). If F is monotonic, then 
C U implies that F(n'''[a;]) C F(? 7 ), so 7 —> F([/). In addition, |II'''[7]| < |F(n'''[a;])| 
together with (c) give the following inequality: 

Nllaa = l«+M| < |r(f!+H)| < 7(|fi+H|) < 7(lkllaa)- (5) 

When applied in the special case U = Uq, this establishes the Cauchy gain conclusion. 

Suppose now that {uji,r]i) G TZ are any two pairs such that and a;“ both exist and 
belong to Uq. In particular, oji —> Uq and uj2 Uq. So both and 7“ exist, by the Cauchy 
gain conclusion. Note that and 0 ,~^[r]i] = {7“} for / = 1 , 2 . We introduce the 

two-element set U = C Uq; note that \U\ = — a;“|. From n+[a;i] C U and (b), 

we have that C F([/), that is, 7“ G F(/ 7 ), for / = 1 , 2 . Therefore 

\vr-vT\ < ir(c/)i < im) = 

which proves the incremental limit property. I 


Remark 3.2 The Cauchy gain (but not the incremental limit gain) results in Lemma 3.1 


can 


be tightened provided that one knows that 7 is continuous, as is the case when considering 
behaviors defined by differential equation systems, and even further provided that uj is con¬ 
tinuous, as is the case when dealing with feedback configurations in the latter case 

assuming that U is locally compact (which is automatically satisfied in all finite dimensional 
applications of the results). To be precise, let us denote by | 17 |^ the maximal diameter of the 
connected components of a set U, that is, the supremum of the quantities \u — v\ taken over 
all pairs u, v which he in any given connected component of U. In general, for any continuous 
and precompact uj, and any subset U such that n+[a;] C U, it holds that ||w||aa — 
because fl"*" [w] is connected and thus lies entirely in a single connected component of U. Then: 


• if 7 is continuous for every (to, 7) G 7 ^ then assumption (c) can be weakened to “|F([/)|^ < 
7(|C/|) for every compact subset U C C/g”, 
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if in addition a; is continuous for every (w, r/) G 7 ^ and U is locally compact then assump¬ 
tion (c) can be weakened to “|r(C/)|^ < 'y{\U\) for every compact and connected subset 
UCUo\ 


Indeed, in the proof of Lemma | 3 . 1 ] observe that if rj is precompact and continuous then is 

connected, so C r(n'''[u;]) implies that ||f?||aa — this is all that is needed 

in If also U is locally compact and uo is continuous, then co ^ U (compact) implies that lo 
is precompact, which together with continuity says that 17 '*'[w] is connected, and therefore in 
order to prove dD, (c) only needs to be applied with the connected set U = □ 

4 Systems of Differential Equations 

A particular class of behaviors, in fact the main objects of interest in this note, are obtained as 
follows. We consider systems of differential equations with inputs and outputs: 

X = f{x,u ), y = h{x) ( 6 ) 

for which states x{t) evolve in a subset A of a Euclidean space M”', inputs take values u{t) in a 
complete metric space U and outputs take values y{t) in a complete metric space y. (Typically 
in applications, U and y are any two closed subsets of Euclidean spaces.) Technically, we assume 
that f : Xq xlA ^ M” is defined on an open subset Xq C M"" which contains X, is continuous, 
and is locally Lipschitz in x uniformly on compact subsets oi Xq lA] the map /i : T — > T is 
assumed to be continuous. Eurthermore, X is an invariant and forward complete subset, in the 
sense that, for each Lebesgue-measurable precompact input oj : M>o —> U, and each initial state 
Xq G X, the unique solution ^{t) = (p{t,XQ,uj) of the initial value problem ^(t) = f{^(t),u}{t)), 
^( 0 ) = Xq, is defined and satisfies ^{t) G X for all t > 0. (The function ^ is Lipschitz, and hence 
differentiable almost everywhere; if oj is continuous, then ^ is continuously differentiable.) To 
any given system (^ one associates a behavior IZ, with input-value space U and output-value 
space y, defined by: {u>, rj) € TZ if and only if lo is precompact and Lebesgue-measurable, and 
there exists some xq G T such that T]{t) = h{ip{t,XQ,uj)) for all t G M>o. We call IZ the behavior 

of®- 

Remark 4.1 A minor technicality concerns the fact that Lebesgue-measurable functions are, 
strictly speaking, not functions but equivalence classes of functions, so one should interpret 
the “limsup” in the definition of asymptotic amplitude in an “almost everywhere” manner; 
similarly, we interpret “precompact” as meaning that there is some to in the given equivalence 
class whose values all remain in a compact. From now on, we leave this technicality implicit; 
in applications to stability of feedback loops involving systems of differential equations, all the 
functions considered are continuous -even differentiable- so the issue does not even arise. □ 

We will obtain sufficient conditions for the existence of the two types of gains, expressed in 
terms of Lyapunov-type functions. 

Given a subset U we will say that a function 

1/ : A ^ M>0 

is a U-decrease function provided that the following properties hold: 
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• V is proper, that is, {x G | a < F(rE) < b} is a compact subset of X, for each o < 6 in 

iK>o; 

• y is continuous; 

• for each x G X which does not belong to Zy ;= {x \ V{x) = 0}, it holds that V is 
continuously differentiable in a neighborhood of x and 

VV{x) ■ f{x,u) < 0 (7) 

for all u G U. 

(We understand continuous differentiability in the following sense: there is a neighborhood of 
X in Xq such that V extends to this neighborhood as a function.) 

Lemma 4.2 Suppose that 17 is a [/-decrease function, for some compact subset U CU. Pick 
any Lebesgue-measurable precompact u) : M>o —> h( and any solution ^ of the system ^ = /(^, a;). 
Suppose that either: 

1. there is some Tq > 0 such that uj{t) G U for all t >Tq, oi 

2. uj ^ U and ^ is precompact. 

Then ^ —> Zy. 

Proof. Given any uj and we will first let a > 0 be arbitrary and prove that the set 14 := 
{x I V{x) < a} has the property that, for some T* > 0, 

m^Va yt>T*. (8) 

If the assumption is that uj ^ U as t —> oo and that ^ is precompact, that is to say, there 
is some compact subset Cq of X such that ^(t) G Cq for all t > 0, then we introduce b := 
max{l/(x),x G Cq} and the set C := V~^{[a,b]). Note that ^{t) G C whenever > a, by 

the choice of b. Since, by properness of 17, C is a compact subset of df \ Zy, by Property (|^ 
there is some a > 0 and some neighborhood U of [/ in so that VP(x) ■ f{x,u) < —a for all 
X G C and all u G U. Since uj —f U, there must be some Tq such that uj{t) G U for all t > Tq. 
Thus, 

^V{x) ■ f{x,uj{t)) < -a < 0 VxGC Vt>To. (9) 

If, instead, the assumption is that there is some Tq > 0 such that uj{t) G U for all t > Tq, we 
pick To to be any such number, and let C ■.= {x \ V{x) > a}. So once more we have that 
V17(x) • f{x,uj{t)) < 0 for all X G C and all t > Tq. 

Claim: Let Ti := inf{t > Tq \ V{f,{t)) < a} (if V{f,{t)) > a for all t > Tq, we define 
Ti = +CX)). Then P('^(t)) < 17(^(To)) for all t G [To,Ti) and V{^{t)) < a for all t > Ti. 

Proof of the claim: Suppose that ^(t) G C for all t in some interval (ri,r 2 ) with ri > Tq. 
Then dV{f{t))/dt = V17(^(t)) • f{^{t),uj{t)) < 0 for almost every t G (ri,r 2 ). Therefore, 
17(^(t)) is decreasing on this interval, and we have that V{f,{t)) < 17('^(ti)) for all t G {ti,T 2 ). 
In particular, for each t G {Tq,Ti), by minimality of Ti we know that 17(^(t)) > a and so 
f{t) G C. This proves the first part of the claim: 17(^(t)) < I7(^(To)) for all t G [To,Ti). If 
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Ti = oo, there is nothing more to prove. So assume that Ti < oo and there exists some S > Ti 
such that V{^{S)) > a. Then there is some T G [Ti,5) such that V{^{T)) = a. We pick 
T' G [Ti,5) to be maximal with this property. It follows that V{^{t)) > a for all t G {T',S]. 
Applying the above argument with ri = T' and T 2 = S, we have that V{^{S)) < a = V{^{T')), 
a contradiction. So the claim holds. 

We conclude that V{^{t)) < max{a, I/(^(0))} for all t > Tq. Therefore the trajectory ^ is 
precompact, and the first case in the Lemma is included in the second case, so we can assume 
that @ holds. We claim that this means that Ti < oo, so that holds with T* = Ti. Indeed, 
if this were not true, then G C for all t > Tq, so dV{^{t))/dt < —a for almost all t, which 

gives < I^('^(0)) — at for all t > Tq, which is impossible since V is nonnegative. 

To conclude that ^ —> Zy, since ^ is precompact we need only show that its omega-limit 
set 11"''[^] is contained in Zy- To see this, we pick any z G and a sequence ^{ti) —> z. So 

^(^(^*)) ^(^)- If -2 0 Zy, let a := V{z)j2 ^ 0. Then Property (|^ gives that V{^{ti)) < a 

for all i large enough, which says that limsupj V{^{ti)) < a, contradicting V{^{ti)) —> 2a. Thus 
Z G Zy. I 


Theorem 1 Suppose given a behavior IZ of a system and for for each compact subset 
U CU, a U-decrease function Vjj. Then: 

1. For each compact subset U TU and for every {ui,r]) G TZ satisfying u ^ U, it holds that 
V K^Vu)- 

2 . If there is a compact subset Uq FU and there is some 7 G /Coo such that 

\h{Zy^)\ < 7 (|C/|) (10) 

for every compact U C Uq, then IZ has Cauchy gain 7 on Uq and incremental limit gain 
7 on Uq. 

3. If there is some 7 G /Coo such that ( [ 7 ^ holds for every compact subset U C U, then IZ 
has Cauchy gain 7 and incremental limit gain 7. 


Proof. We will first show that, for every triple with ui precompact and Lebesgue- 

measurable, such that (,{t) = f{(,{t),uj{t)) and r]{t) = h{^{t)), the following properties hold: 


(i) and r] are precompact; 

(ii) for each compact U UU,\iuj—*U then ^ and rj h{Zy^). 


(This will prove, in particular, the first assertion of the theorem.) Since to is precompact, 
there exists some compact set, let us call it U', such that u>{t) G U' for all t. The first case 
in Lemma |4.2|, applied to U' and V' = Vu with Tq = 0, gives that ^(t) —> Zyi, so, being 


so, 

continuous as a function of t, f is precompact. Next we apply once more Lemma using now 
the second case with any given compact U and the /7-decrease function V = Vjy, to conclude 
that ^ —> Zy. Since the set Zy is compact and the mapping h is continuous, it follows that 
also r/(t) = h{f^(t)) —> h{Zy) as t ^ 00 , and 7 is precompact as well. 

Next, we pick any compact Uq U U as in the second assertion, so that for every compact 
subset U C Uq we have that \h{Zyjj)\ < 7(|/7|), and let r(/7) := h{Zyjj). We will apply 
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Lemma 3.1. Property (c) in that Lemma holds by definition of P. Also, (a) holds, by (i). To 
prove that (b) is true, suppose that n+[t(;] C [/ C Uq. Since u is precompact, u —> so 

also u U . By (ii), we know that rj — > h{Zv^), and so !!'''[/?] C h{Zvjj) = r(L^), as desired. 
The Lemma then says that TZ has Cauchy gain 7 on Uq and also has incremental limit gain 7 
on Uq. 


Finally, given an arbitrary pair (a;,r/) G TZ, we pick some compact Uq such that uj{t) G Uq; 
then the just-shown Cauchy property on Uq gives that ||??||aa, — 7(ll‘^llaa)’ similarly for the 
incremental gain. I 


5 A Class of Examples 

As an illustration of gain computations and small-gain stability arguments, we consider systems 
which consist of cascades of several subsystems, each of which can be individually described by 
some ordinary differential equation Xi = f{xi, Ui) with input Ui. The input ui = uto the first of 
the systems in the cascade is an external one, while the intermediate inputs Ui, i > 1 , between 
two stages depend on the state of the preceding stage. In a biological application, Xi{t) might 
represent the amount present, at any given time t, of the activated form E* of an enzyme Ei 
whose production rate is, in turn, dependent upon the amount present of the activated form 
E*_^ of the enzyme Ei^i. We allow transport delays in between stages. This leads to systems 
given by sets of delay-differential equations as follows: 

xi{t) = fi{xi{t),u{t)) 

X2{t) = f2{x2{t),Xl{t - Tl)) 

Xn{t) = fniXn(t),Xn-l{t - Tn-l)) 

where ti, ... ,r„_i > 0 are the delays among the stages of the process (the particular case in 
which there are no delays is included in this formalism by setting all r* = 0). See Figure where 



Figure 3: Cascade of T^j’s and Delays 


xj{t) := Xi(t — t) and we use TZi to denote the behavior associated to the system x = fi{x,u) 
with output y = X. One often asks about such systems, see e.g. |, 0 , 0 ,|T|, whether adding a 
feedback loop from the last stage to the first, as shown in Figure Q, might introduce instabilities, 



Figure 4: Cascade of T^j’s and Delays, With Feedback to First Stage 


such as oscillations or even chaotic behavior. Specifically, one may have, for instance, that the 
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action of u on the first subsystem is inhibited by the final product Xn- Assuming that all the 
variables Xi as well as the external input u are scalar, and take only nonnegative values (as 
is for instance the case when variables represent chemical concentrations), a typical model for 
inhibition is obtained when the first equation becomes 

(other expressions for inhibition are also possible, of course), where the “gain” k > 0 serves to 
parametrize the feedback strength. Note that we are also allowing for an additional delay in the 
feedback. Suppose that we are interested in analyzing the case in which u{t) equals a constant 
value /i, so that the effective input being fed to the first subsystem is a;(t) = 'ip{x'^{t)) = 
'ip{xn{t — Tn)), where ip is the following function: 

X) = -;- 

1 + kx 

(for some particular values of /r and k). The closed-loop system may be viewed as the feedback 
interconnection of the memoryless behavior with the behavior of the forward 

composite system with output xj^ , that is, the composition 

= Vr^oTZnO O . . . O O • 

Suppose that each TZi has Cauchy gain 7 ^ and also incremental limit gain 7 ^. Then TZ has gain 
7 = 7n o • • • o 7 i of both types. Since ip has Lipschitz constant kfi, has both gains kul. 
Therefore, provided that the small gain condition 

'y{k^r) < r Vr > 0 (12) 

holds, one concludes from Lemma |l.5| that there is some value u such that, for every solution of 
the closed-loop system, oj u. This means, in turn, because each TZi has a Cauchy gain, that 
every state variable Xi converges to a unique equilibrium (independently of initial conditions). 

The problem, therefore, is to estimate gains 7 * for the systems TZi. We briefly discuss one 
situation, itself of great interest, in which estimates can be obtained. 

We suppose given intervals A) = [aj,6j] C ]R>o, and sets Ui C ]R>o, i = l,...,n, with 
lAi = M>o for i > 1, such that any solution of x = fi{x, u) with initial conditions in A) and input 
with values in Ui remains in A). In a typical biological application, one may have A) = [0, 
where is the maximum possible amount of a substance, such as the activated form of an 
enzyme, that may be synthesized. Also, suppose given, for each i, a strictly increasing and onto 
function 

gi : [ai,bi) M>o 

with the following properties: 



1. the restriction of < 7 ^ ^ : M>o ^ [ai,bi) to Ui is Lipschitz, with Lipschitz constant A*; 

2. X < g^^{u) fi{x,u) > 0, and x > g~^{u) fi{x,u) < 0, for every u£Ui and x € A). 


Then, TZ admits both Cauchy and incremental limit gain 7 (r) = Ai... A^r, and (12) becomes: 

1 


kg < 


Ai.• • A^ 


(13) 
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This is proved as follows. Fixing any i = 1,... ,n, we drop subscripts and write X = Xi,U = Ui, 
g = gi, X = Aj. For each compact subset U <^14, we let c := mint/ and d := maxC/, so that 
U C [c, d] and \U\ = d — c, and define Vu ■ X ^ ]R>o to be the distance from any x to the set 

g~^{[c,d]) = [g~^{c),g~^{d)] 

(recall that g~^ is an increasing function). So Zvjj = [g~^{c), g~^{d)], and Vu{x) = g~^{c) — x if 
g{x) < c, Vu{x) = X — g~^{d) if g{x) > d. Note that has diameter \Zy^\ < A |fi — c| = A |17|. 
Furthermore, Vjj is a [/-decrease function, because Vu is continuous, proper, differentiable 
outside Zy ^, and satisfies the decrease condition. Indeed, pick any x £ X \ Zy^ and u £ U. 
There are two cases: x < g~^{c) or x > g~^{d). In the first case, x < g~^{c) < g~^{u) (since 
u £ [c, d]), so VI/(x) • f{x,u) = (—1) • f{x,u) < 0, and the second case is similar. Theorem || 
(part 3) then applies, so the corresponding behavior TZi has both Cauchy and incremental limit 
gain 7 i(r) = A^r, and therefore the cascade (with arbitrary delays) has both gains equal to 7 , 
as claimed. 

The requirement that each g£^ : Lii [oj, hi) must have Lipschitz constant A* can be relaxed 
to: 

the restriction of g'^^ to Ui is Lipschitz with Lipschitz constant Aj (14) 

for each i = 1 ,..., n, where we define, inductively, the intervals Ui := lAi and 


Ui+i := ^{Ui) C Ui+i 


for i = 1,..., n. For each compact subset U C Ui, we have that \Zyjj \ < Xi\U\, so, by Theorem || 
(part 2, applied n times, with Uq = Ui, i = 1,... ,n) we conclude that each TZi has Cauchy 
gain as well as incremental limit gain ji{r) = Xr on Ui. In addition, for each i = 1,... ,n — 1 
and every {uj,g) £ TZi such that uj ^ Ui, Theorem || (part 1) insures that 7 ^ I/i+i. The 
pure delays Dr^ have identity gains, and of course satisfy oj [/j+i 7 —[/j+i. So, arguing 


(for each consecutive pair of subsystems in the cascade) as in Section 2.1, we conclude that TZ 
admits both Cauchy and incremental limit gain 7 (r) = Ai... A^r provided condition holds. 

Let us specialize even further. We assume from now on that each function fi has the 
following form: 

fiix,u) = -ai{x) + u(5i{x), 

where the functions ai and fdi are nonnegative on T = [oj, hi], ai is strictly increasing and f3i is 
strictly decreasing, and ai{ai) = Pi^bi) = 0. Since fi{ai,u) > 0 and fi{bi,u) < 0 for all u £ Ui, 
the interval Xi = [ai,bi] is invariant. For each i, we let 


9iix) := 


ctijx) 

Pi{x) 


for X £ [oijbi). Then gi is strictly increasing, because a* increases and Pi decreases, and it 
satisfies gpOi) = 0 and gpx) —> 00 as x —> h~, so it is onto M>o. Given any x £ [oj, 6 j) 
and u £ Ui, if x < g~^{u) then ai{x)/Pi{x) = gpx) < u implies fi{x,u) > 0 and similarly 
X > g~^{u) fi{x,u) <0. If X = then fi{x,u) = —apb) < 0. In conclusion, the functions 
gpx) := 7 ^^ are as required for the above computations, and the gains can be computed in 
terms of the Lipschitz constants in (14), computed on the sets Ui. 


13 






5.1 MAPK Cascades 


As an application, and in fact the original motivation for this study, we pick the case when 
every Aj = [0,1] (for now, we let Ui be arbitrary, but it will be restricted below), and 


ai{x) 


bjX 
Ci + X 


and Pi (x) 


djjl - x) 
e, + (1 - x) 


(for some positive constants bi, Ci, di, ep. We wish to study the stability of the inhibitory closed- 
loop system: 


bixi n di{l - xi) 

ci + xi 1 + kx^ ei + (1 — xi) 

b2X2 ^ ^ 2(1 - X 2 ) 

C2 + X2 ^ 62 + (1 - X2) 
hxs ^ dsjl-Xs) 

C3 + 3:3 ^ 63 + (1 - X3) 


( 15 ) 

( 16 ) 
( 17 ) 


where the > 0. Such equations arise, for instance, as follows. 

Mitogen-activated protein kinase (MAPK) cascades constitute a type of “biological module” 
or “subcircuit” which is implicated, in several variants, in a large variety of eukaryotic cell signal 
transduction processes, cf. ii [l^ . This highly conserved signaling cascade processes inputs 
- themselves triggered, in turn, by extracellular stimuli - into output signals responsible for 
diverse cellular behaviors: proliferation, growth, and differentiation (hence the name), as well 
as movement, stress responses, and death. The basic mechanism is that of a cascade of three 
subsystems, each of which consists of one or more reversible enzyme activations. 


Subject to conservation laws (stoichiometry relations), each subsystem is usually described 
in terms of one or two differential equations, see for instance (The models in these 

references do not include delays among levels in the cascade, but in our formalism, arbitrary 
delays do not affect the results, and they are biologically plausible.) For simplicity, we pick 
a model with one equation in each level, as in |j^, and the last section of |^. In general, 
one would have all A) = [O,!?^], where Ei is the total amount of enzyme present (activated 
plus nonactivated), but we may take all A) = [0,1] after nondimensionalization, as was done 
in 11, 0]- These references, and especially Kholodenko’s work, emphasized the fact that 
inhibitory feedback, which seems to be present in naturally occuring cells, could, theoretically, 
produce oscillations. As oscillations in MAPK cascades do not appear to occur naturally, an 
interesting mathematical question is to find conditions on gains insuring lack of oscillations. 
We do this next. 


We hrst show that the functions g~^ are always Lipschitz, and compute an estimate of 
the constant. This will prove that stability is preserved under small enough feedback, but the 
estimates may be too conservative. After that, we describe a numerical approach which allows 
sometimes quite tight estimates. To obtain the general bounds, we compute, for x G [0,1): 


9iix) 


bi_ ejx'^ + Ci{x - Ip + CiCj 

di (cj + x)2(l - x)2 


and use (taking derivatives to minimize) these lower bounds: 


-t- Ci{x 


1)2 > 


CiCi 
+ Ci 
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(Cj + x)(l - x) < (l/4)(ci + 1)^ 
so as to obtain the following estimate: 


9iix) 


> Si 



(Ci + 1)"^ 



Ci -t- Cj 


> 0 . 


Thus Aj = l/5i are Lipschitz constants as desired. 

Since we are ultimately interested in the effect of inhibitory feedback given by a function 
V’(0 = as in (|Tl]), where ^ is a (possibly delayed) value of xs, which ranges over the 

interval [0,1], the only inputs u that must be considered are those in [y^, /u], So, from now, on 
we suppose that the first input set has the form: 


Ui = [u, oo) 


for some ft > 0. The appropriate value of u will depend upon prior upper bounds on the 
feedback gains k and external inputs /i which are of interest. We let Ui = lAi and introduce 
[/j+i = g~^{Ui) for i = 1,2,3 as done earlier, and compute a Lipschitz constant Aj for the 
restriction of g~^ to Ui for each i = 1,2,3 as in (|l^). Writing xq = u and gi(xi) := Xi-i for 
i = 1,2,3, we have that U 2 C [xi,l], U 3 C [x 2 ,l], t /4 C [xs,!]. When applying the small- 
gain condition (IJ), the quantity of interest is the “total gain” A = A 1 A 2 A 3 of the cascade. 
An upper bound on each A* can be obtained, for any given u, by maximizing the derivative 


of g~^ on Ui, or equivalently (and most conveniently, as this involves no functional inversion 
and each gi is a simple rational function) as A* = 9i{ui)~^, where 0 i{u) is the minimum of 
g[ on [xi,l]. The functions 6 i depend, of course, on the actual parameters bi, etc. Defining 
9{u) := 9 i{u)92{u)93{u), we conclude that every solution of the delay-differential system 
will satisfy Xi(t) —> 0 as t —>■ 00 provided that the following condition holds: 


k < min 


9{u) g, 


- 1 




u 


(18) 


The first term represents the small-gain condition (^) (since ft = ^), while the second insures 
that u = = ^(1 -|- kx^f)~^ belongs to the input set Ui = [11,00) for all X3 e [0,1]. 

Figure ^ provides a plot (obtained using the “minimize” function in Maple) of the function 9 



Figure 5: The Function 9 
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for a concrete numerical example which takes the coefficients used in |13]: 

6 i = Cl = ei = 62 = 0.1, C 2 = 62 = C 3 = 63 = 0.01, 63 = 0.5, di = d 2 = = 1. 


( 19 ) 


There is a sharp transition at around u = 0.055. In order to obtain A small, let us say A < 1, it is 
reasonable to pick the value u = 0.061, for which 6 {u) rs 1.39933 and so A = l/6{u) ^ 0.71463 
(picking instead u = 0.06 would give A 1.134). If we now pick ^ = 0.3, as in the 
constraints (1^) become k < min{4.6644,3.918} = 3.918. In conclusion, any feedback with gain 
k < 3.9 is guaranteed to preserve stability (for external input u{t) = 0.3, and for any delays). 


One may ask how tight is the bound k < 3.9. For the system with no delays, numerical 
experimentation leads to the conclusion that, as the parameter k increases, a Hopf bifurcation 
occurs at around k = 5.1. The solution with initial conditions x(0) = 0, and p = 0.3, k = 5.2 
is oscillatory and is plotted in Figure ^ (Linear instability in this context always leads to 



Figure 6 : Oscillations when k = 5.2 and /i = 0.3 


existence of periodic solutions, cf. |^, |l^.) Thus the bound is fairly tight even when there are 
no delays. 


5.2 Local Exponential Stability 


For systems of the special form being considered, linearized stability analysis can be employed 
in order to determine local exponential stability of the feedback system, appealing to classical 
small-gain theorems as in [|I|, IT, |l^ ^|. (A computational difficulty when doing this, however, 


is that feedback laws such as u = ipix) change equilibria, and the new equilibria are usually 
not computable in closed-form.) Given any system of the form x = f{x,u) = —a{x) + u(3{x) 
as above, and any u, we may compute the linearized system z = az + bv at the equilibrium 
values x = X = g~^{u) and u = u. This has a = ^{x,u) and b = ^(x,u}. From a/b = 
(—a'(x) + uP'(x))//3(x) and u = a{x)/(5{x) = g{x), one obtains: 


a'{x)l3{x) — a{x)P'{x) 
/32(x) 


= g'ix) = 


1 


(g-^nu) 


On the other hand, the Hoo gain (induced operator norm) of the system i = az + bv 
is max{ 6 /lieu-|-a| ,cu € K} = | 6 /a|. We conclude that {g~^y{u) equals the Hoo gain of the 
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linearized system. By induction on the cascade, the linearized cascade system has an Hoo gain 
equal to X, so the same inequalities on k and insure local exponential stability. (Linearized 
analysis cannot by itself guarantee the existence of equilibria for the closed-loop system; only 
after equilibria are known to exist, this linearized small gain argument can be used.) 

The “secant condition” for stability, see is often used for linearized stability 

analysis of inhibitory feedback systems such as the ones considered here. This condition says 
that a matrix 

/ ai 0 0 —^ 

P 2 Oi2 ■ ■ ■ 0 —0 

Vo 0 ■■■ I3n Oln J 

with all aj < 0 and all /3i > 0 is Hurwitz provided that: 

<(sec0". 

For n = 3 as in our example, this means that a closed-loop gain margin of (sec7r/3)^ = 8 can 
be tolerated while preserving stability, for the linearized system (no assertion is made about 
phase, so no delays are allowed). The condition k < gi/u — 1, which guarantees that u = 


/3i. 

■Pn 

ai. 

■ Oln 


belongs to the input set [ 11 , 00 ), must still be satisfied, but the bound (^) may be relaxed to 
k < min{^^^, ^ — 1}. In order to exploit this condition for the above numerical example, a 
bit of experimentation leads us to pick u = 0.05763 (instead of 0.061), so A = l/9{u) ss 6.32. 
Using again /r = 0.3, the condition k < ^/u — 1 imposes a constraint of approximately k < 4.2. 
For any such k, we have that k ■ yL ■ X < 7.9632 < 8 , as wanted. In other words, the secant 
rule allows us to conclude that a feedback gain of A: < 4.2 may be tolerated so as to guarantee 
linearized stability. This is only a slight improvement over the estimate k < 3.9 obtained from 
the nonlinear small-gain result, and it comes at the cost of assuming no delays and insuring 
only local stability for the original system. 
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